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DETAILED ACTION 
Continued Examination Under 37 CFR 1.114 

1 . A request for continued examination under 37 CFR 1.114, including the fee set 
forth in 37 CFR 1.17(e), was filed in this application after final rejection. Since this 
application is eligible for continued examination under 37 CFR 1.114, and the fee set 
forth in 37 CFR 1.17(e) has been timely paid, the finality of the previous Office action 
has been withdrawn pursuant to 37 CFR 1.114. Applicant's submission filed on 
7/5/2006 has been entered. 

Response to Arguments 

2. Applicant's arguments with respect to claims 1-24 have been considered but are 
moot in view of the new ground(s) of rejection. 

Regarding claim 16, the applicant's failure to adequately traverse the examiners 
taking of Official Notice in the last Office Action is taken as an admission of the fact(s) 
noticed. 

Claim Rejections - 35 USC § 103 

3. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made". 
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4. Claims 1,3, 7-9, 12, 13, 16, 21, 22, 23 and 24, are rejected under 35 U.S.C. 
103(a) as being unpatentable over Hennes (US 6,665,985 B1) in view of Weinblatt (US 
4,483,681). 

Regarding claims 1, 21 and 23, the following limitations are met by Hennes - 
"An audience response determination apparatus for determining an audience 

response" (show control system 500 - fig. 5A & 5B and theater assembly 100 - fig. 4; 

col. 6, lines 37-38); and corresponding method; and "data recording medium recording a 

processing program" (col. 6, lines 64-67; col. 1, line 67 - col. 2, line 1; col. 6, lines 27- 

33): 

"overall state detection means for detecting the overall state of an audience" 
(Hennes discloses control system 500 - fig. 5A & 5B using two types of sensors, 
motion-sensors, and microphones (which both read on the "overall state detection 
means") to detect general audience motion, and audience sounds (which reads on "the 
overall state of an audience"); col. 6, lines 45-49); 

"individual state detection means for detecting the individual states of the 
members of the audience" (Hennes further discloses the control system 500 - fig. 5A & 
5B using motion-sensors/sound-sensors (which read on the "individual state detection 
means" ) to detect motion/sound (which reads on the "individual states") of groups of 
individuals in the audience (which reads on "members"); col. 6, lines 37-45); and 

"determination means for determining the audience response on the basis of 
information detected by said overall state detection means" (col. 6, lines 45-59; in which 
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show control device 520 - fig. 5A & 5B reads on "determination means") and "by said 
individual state detection means" (col. 6, lines 37-45) (Hennes' sensors 510 provide the 
information/data from which 520 derive the "audience response", in which "audience 
response" reads on the audience's perception of reality which is derived from the 
audience's interaction and movements/sounds within the environment based on the 
special effects (stimuli) produced by the theater sound/visual projections, e.g., a child 
audience member "sees" a dolphin, gets immersed in the environment, starts jumping 
around and yelling in excitement, and the control system determines/senses this 
excitement (increased motion/sound) based on information from the sensors; col. 1, 
lines 43-65 & col. 7, line 65 - col. 8, line 2), 

wherein the determination means (show control device 520) for determining the 
audience response comprises an audience state determination unit for estimating 
(determining) the audience response based upon identifying values of respective 
determination signals (reads on 520 extracting the audience motion/position/sound, i.e., 
state information, from the sensors 510, e.g., 520 determines the audience position, 
motion or stillness, quietness or loudness and activeness; col. 6, lines 37-47 in which 
the motion and position determinations, inter alia, are used to identify audience 
response; col. 1, lines 43-65; regarding the limitation identifying values of respective 
determination signals, Hennes inherently discloses it in order to identify the position of 
the audience because values have to be determined to detect position, e.g., exact 
values, i.e., x-y type coordinates/values or relative values, i.e., to the left or right of 
something). 
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However, Hennes fails to disclose auxiliary information indicates a current state 
of playback being presented to the audience. 

In an analogous art, Weinblatt teaches in a system for determining audience 
response to presentation stimuli (fig. 1; vol. 2, lines 5-10) it is desirable to provide 
auxiliary information indicating a current state (mode) of playback being presented to 
the audience (col. 3, lines 41-45,58-62; col. 2, lines 18-21; input switch 38-fig. 1) for 
evaluating viewer response, interest, and visual impact on the viewer (col. 2, lines 37- 
39,44-45; col. 4, line 20; col. 2, lines 24-25,29-30). 

Therefore it would have been obvious to one of ordinary skill in the art at the time 
of the applicant's invention to modify the system of Hennes to include auxiliary 
information indicates a current state of playback being presented to the audience as 
taught by Weinblatt for the added advantages of providing increased control/effect on 
future user responses and interests and better predicting user response by detecting 
the characteristics of the environment, i.e., audiovisual presentation/playback system, 
and the corresponding responses/interests they induce in the audience (Weinblatt - col. 
2, lines 38-39,45; col. 4, lines 20). 

Regarding claims 7, 22 and 24 the following limitations are met by Hennes - 
"A playback output control system for controlling the output from playback means 
for the playback and output of data to be seen or heard by an audience" (playback 
devices 530/projectors 350 and sound system 400 read on "playback means"; show 
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control system 500 - fig. 5A & 5B and theater assembly 100 - fig. 4) and corresponding 
method; and "data recording medium recording a processing program" (col. 6, lines 64- 
67; col. 1, line 67 - col. 2, line 1; col. 6, lines 27-33): 

"overall state detection means for detecting an overall state of said audience" 
Hennes discloses control system 500 - fig. 5A & 5B using two types of sensors, motion- 
sensors, and microphones (which both read on the "overall state detection means") to 
detect general audience motion, and audience sounds (which reads on "the overall 
state of an audience"); col. 6, lines 45-49); 

"individual state detection means for detecting individual states of the members 
of said audience" (Hennes further discloses the control system 500 - fig. 5A & 5B using 
motion-sensors/sound-sensors (which read on the "individual state detection means" ) 
to detect motion/sound (which reads on the "individual states") of groups of individuals 
in the audience (which reads on "members"); col. 6, lines 37-45); 

"determination means for determining an audience response on the basis of the 
information detected by said overall state detection means" (col. 6, lines 45-49; in which 
show control device 520 - fig. 5A & 5B reads on "determination means") and "by said 
individual state detection means" (col. 6, lines 41-45) and "by said individual state 
detection means" (col. 6, lines 37-45) (Hennes' sensors 510 provide the 
information/data from which 520 derive the "audience response", in which "audience 
response reads on the audience's perception of reality which effects the audience's 
interaction and movement within the environment based on the special effects (stimuli) 
produced by the theater sound/visual projections, e.g., a child audience member "sees" 
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a dolphin, gets immersed in the environment, starts jumping around and yelling in 
excitement, and the show control device 520 determines this excitement (increased 
movement/sound) based on information from the sensors; col. 1, lines 43-65 & col. 7, 
line 65 - col. 8, line 2); and 

"control means for controlling the operation of said playback means based on the 
audience response determined by said determination means" (show control device 520 
reads on "control means"; col. 6, lines 52-58; col. 7, lines 1-19), 

wherein the determination means (show control device 520) for determining the 
audience response comprises an audience state determination unit for estimating 
(determining) the audience response based upon identifying values of respective 
determination signals (reads on 520 extracting the audience motion/position/sound, i.e., 
state information, from the sensors 510, e.g., 520 determines the audience position, 
motion or stillness, quietness or loudness and activeness; col. 6, lines 37-47 in which 
the motion and position determinations, inter alia, are used to identify audience 
response; col. 1 , lines 43-65; regarding the limitation identifying values of respective 
determination signals, Hennes inherently discloses it in order to identify the position of 
the audience because values have to be determined to detect position, e.g., exact 
values, i.e., x-y type coordinates/values or relative values, i.e., to the left or right of 
something). 

However, Hennes fails to disclose auxiliary information indicates a current state 
of playback being presented to the audience. 
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In an analogous art, Weinblatt teaches in a system for determining audience 
response to presentation stimuli (fig. 1; vol. 2, lines 5-10) it is desirable to provide 
auxiliary information indicating a current state (mode) of playback being presented to 
the audience (col. 3, lines 41-45,58-62; col. 2, lines 18-21; input switch 38-fig.1) for 
evaluating viewer response, interest, and visual impact on the viewer (col. 2, lines 37- 
39,44-45; col. 4, line 20; col. 2, lines 24-25,29-30). 

Therefore it would have been obvious to one of ordinary skill in the art at the time 
of the applicant's invention to modify the system of Hennes to include auxiliary 
information indicates a current state of playback being presented to the audience as 
taught by Weinblatt for the added advantages of providing increased control/effect on 
future user responses and interests and better predicting user response by detecting 
the characteristics of the environment, i.e., audiovisual presentation/playback system, 
and the corresponding responses/interests they induce in the audience (Weinblatt - col. 
2, lines 38-39,45; col. 4, lines 20). 

Regarding claim 3, Hennes in view of Weinblatt teach the "overall state detection 
means collects sounds uttered by the entire audience and detects the overall state of 
the audience based on the sounds thus collected" which reads on control system 
detecting audience sounds throughout the audience area (Hennes -col. 6, lines 45-48). 

Regarding claim 8, Hennes in view of Weinblatt teach the "control means selects, 
on the basis of said audience response determined by said determination means, data 
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to be played back by said playback means" (Hennes -col. 6, lines 52-58; col. 7, lines 1- 
19). 

Regarding claim 9, Hennes in view of Weinblatt teach the "control means 
controls, on the basis of said audience response determined by said determination 
means, signal processing on the data played back by said playback means" (signal 
processor 540; Hennes -col. 7, lines 1-5). 

Regarding claims 1 1 and 13, Hennes in view of Weinblatt teach a reduction 
means (show control device 520) for reducing the effect (motion effects, e.g., horizontal 
movement and physical sensations) of sound data played back and output by said 
playback means (sound system 400), wherein overall state detection means detects the 
overall state of the audience by reducing the effect of said sound data (reads on control 
system 500 receiving/detecting the audience motion/sound when the control device 520 
pans the sound from "left" to "right" or lowers the frequency of the sound to induce a 
physical sensation and reaction in the audience; Hennes- col. 7, line 46 - col. 8, line 2). 

Regarding claim 12, Hennes in view of Weinblatt teach the "overall state 
detection means detects the overall state of said audience by collecting sounds emitted 
by the entire audience" (reads on microphone sensors 510 receiving/detecting audience 
sounds throughout the audience area; Hennes - col. 6, lines 45-59). 
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Regarding claim 16, Hennes in view of Weinblatt fail to disclose the limitation "a 
filter which passes a predetermined audio band" and "based on the sound passed 
through said filter". 

The examiner takes Official Notice that it is well known in the art to use bandpass 
filters when processing targeted input sound frequencies in the midst of extraneous 
unwanted sounds and/or noise, e.g., air conditioning noise, because filtering makes 
subsequent analyses of the targeted sound more accurate by extracting the targeted 
sound while attenuating the noise signals. It would be obvious to one of ordinary skill in 
the art at the time the invention was made to modify the system of Hennes in view of 
Weinblatt to include the limitations "a filter which passes a predetermined audio band" 
and "based on the sound passed through said filter" to reject sound frequencies in the 
theater that could not logically correspond to audience sound because they are 
above/below the desired frequency range of audience sound, e.g., very high frequency 
audio played back by the theater sound system or low bass frequencies played back by 
the theater sound system, and/or low frequency air-conditioning noise, etc. 

5. Claims 2, 10 and 11 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Hennes (US 6,665,985 B1) in view of Weinblatt (US 4,483,681) as applied to 
claims 1 and 7 above, and further in view of Huard (US 6,507,353 B1). 

Regarding claims 2 and 10, Hennes in view of Weinblatt teach motion-sensors to 
detect general (entire) audience motion and position (Hennes-col. 6, lines 45-47), 
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however fail to disclose "takes an image of the entire audience" and "based on the 
image taken". 

In an analogous art Huard teaches it is desirable to provide capturing images to 
determine changes in body language/gestural signs and record position information 
about the user (col. 4, lines 41-50; col. 3, lines 22-24; col. 4, lines 12-16) for the purpose 
of analyzing audience signals for affecting actors 16 - fig. 1 (images displayed in the 
interactive theater) (col. 3, lines 22-33 & lines 6-8). 

Therefore it would have been obvious to one of ordinary skill in the art at the time 
of the applicant's invention to modify the system of Hennes in view of Weinblatt to 
include the limitations "takes an image of the entire audience" and "based on the image 
taken" as taught by Huard for the purpose of analyzing audience signals for affecting 
images generated in response to audience body language and position (Huard-col. 3, 
lines 22-33 & lines 6-8). 

Regarding claim 11, Hennes in view of Weinblatt and Huard teach a reduction 
means (show control device 520) for reducing the effect (motion effects, e.g., horizontal 
movement and physical sensations) of sound data played back and output by said 
playback means (sound system 400), wherein overall state detection means detects the 
overall state of the audience by reducing the effect of said sound data (reads on control 
system 500 receiving/detecting the audience motion/sound when the control device 520 
pans the sound from "left" to "right" or lowers the frequency of the sound to induce a 
physical sensation and reaction in the audience; Hennes-col. 7, line 46 - col. 8, line 2). 
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2. Claims 4, 17 and 18 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Hennes (US 6,665,985 B1) in view of Weinblatt (US 4,483,681) as applied to claims 1 
and 7 above, and further in view of Sprout et al. (US 6,409,599 B1). 

Regarding claims 4 and 17, Hennes in view of Weinblatt fail to disclose the 
individual state detection means detects a load applied to each of the audience's seats. 

In an analogous art Sprout teaches it is desirable to provide seats responsive to 
a users physical movements (reads on "load") for enhancing the immersive experience 
(col. 4, lines 37-47). 

Therefore it would have been obvious to one of ordinary skill in the art at the time 
of the applicant's invention to modify the system of Hennes in view of Weinblatt to 
include "detects a load applied to each of the audience's seats" as taught by Sprout for 
the advantage of increasing audience comfort by sitting during the performance and still 
enhancing the immersive experience (Sprout - col. 4, lines 37-40). 

Regarding claim 18 it is analyzed and reject similar to claim 7 above. 

4. Claims 5, 6, 19 and 20 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Hennes (US 6,665,985 B1) in view of in view of Weinblatt (US 4,483,681) as 
applied to claims 1 and 7 above, and further in view of Howell (US 6,600,477 B1). 



Application/Control Number: 09/966,704 Page 13 

Art Unit: 2623 

Regarding claims 5 and 19, Hennes in view of Weinblatt teach motion-sensors 
for detecting individual members of the audience (Hennes-col. 6, lines 37-39), however 
fail to disclose the individual state detection means detects a stepping force as recited 
in the claims. 

In an analogous art Howell, teaches it is desirable to provide a pressure sensitive 
pad 30, - fig. 6 & 7, to detect motion and position information provided by both feet of a 
standing user (col. 7, lines 20-25 & col. 7, lines 54-56) for detecting larger movements 
of the body (col. 7, lines 27-31). 

Therefore it would have been obvious to one of ordinary skill in the art at the time 
of the applicant's invention to modify the system of Hennes in view of Weinblatt to 
include "detects a stepping force" as taught by Howell for the advantage of providing 
additional methods of detecting larger movements of the body of audience members 
(Howell -col. 7, lines 27-31). 

Regarding claims 6 and 20, Hennes in view of Weinblatt and Howell teach the 
further limitations: 

"detecting a stepping force provided by the left foot of each member of said 
audience; and 

second stepping force detection means for detecting a stepping force provided by the 
right foot of each member of said audience" (Howell - col. 7, lines 54-61 ; in which 
motion and position information is recorded for each foot for use in applications, e.g., 
determining the direction a user is standing). 
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5. Claim 14 is rejected under 35 U.S.C. 103(a) as being unpatentable over Hennes (US 
6,665,985 B1) in view of Weinblatt (US 4,483,681) as applied to claims 1 and 7 above 
and further in view of Needham (US 5,726,701). 

Regarding claim 14, Hennes in view of Weinblatt fail to teach the limitation 
"comparing the collected sounds with a reference sound level". 

In an analogous art Needham teaches it is desirable to determine an audience 
response ("state") by comparing collected audience signal to a threshold ("reference 
sound level") for determining the response of the audience (col. 8, lines 14-38; col. 6, 
lines 9-13); 

Therefore it would have been obvious to one of ordinary skill in the art at the time 
the applicant's invention to modify the system of Hennes in view of Weinblatt to include 
"comparing the collected sounds with a reference sound level" as taught by Needham 
for the advantage of better controlling the sensitivity to the input for managing the 
desired effect. 

6. Claim 15 is rejected under 35 U.S.C. 103(a) as being unpatentable over Hennes (US 
6,665,985 B1) in view of Weinblatt (US 4,483,681) and Needham (US 5,726,701) as 
applied to claims 7, 12 and 14 above and further in view of Schwartzberg (US 
2,593,204). 
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Regarding claim 15 Hennes in view of Weinblatt and Needham teach varying the 
threshold based on empirical results to reject background noise (Needham - col. 8, lines 
64-67) however, they fail to teach "on the basis of the audience size". 

In an analogous art Schwartzberg teaches it is desirable to vary the sensitivity of 
an audience input microphone based on the size of the audience for obtaining an 
accurate measure of the sound level based on the fullness of the auditorium (col. 1, line 
53 -col. 2, line 20). 

Therefore it would have been obvious to one of ordinary skill in the art at the time 
of the applicant's invention to modify the system of Hennes in view of Weinblatt and 
Needham to include "on the basis of the audience size" as taught by Schwartzberg for 
the advantage of more accurately measuring the sound level of an audience based on 
the degree of audience member density. 

Conclusion 

6. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Clyde H. Jones III whose telephone number is 571-272- 
5946. The examiner can normally be reached on 9-5:30 p. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Chris Grant can be reached on 571-272-7294. The fax phone number for 
the organization where this application or proceeding is assigned is 571-273-8300. 
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Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 
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